All Questions
15 questions
1vote
1answer
178views
Design considerations for data shared across multiple users: is Redis a good candidate?
I have an app that has an assets table like the following: user_id code current_price 1 ALUP11 12.5 2 ALUP11 11.9 user_id and code are unique together and current_price is updated if the user triggers ...
7votes
1answer
9kviews
Best way to store quite large JSON objects?
I'm building an app where I need access to quite large reports about different publicly accessible URLs, JSON objects about 200kb to 500kB in size. Each user would generate hundreds of these reports ...
- 171
2votes
1answer
337views
Event Driven Architecture how should channels be used
I'm using event driven architecture, to perform realtime signal proccessing and to provide independent metrics. I decided to use a redis cluster to act a cache and a message bus. I'm a bit confused ...
- 335
1vote
3answers
4kviews
Redis write-through cache vs write-behind cache (message queue?)
I have a simple use case: Newsfeeds aggregated based on posts that are linked to geopoints Users can comment on feed posts Users can like feed posts and comments I'm certain that Redis as a cache ...
- 185
-1votes
1answer
123views
Design review for a Cache aside system
I am maintaining a system where a list of string ids are stored against a container (using the term here as a generic entity) object. The database used is MySQL and the table structure looks like this....
0votes
1answer
106views
Design decision of reading XLSX file at once or intermittently
I am working on converting an existing python based monolith solution to a microservice. The current flow is pretty straight forward: Accept XLSX as input -> Run some complex algorithms based on ...
- 173
0votes
0answers
1kviews
How to cache timestamp based key values with a distributed cache?
I have a dataset in a key value store (similar to Cassandra). The data model is - Key - ServiceName / timestamp_in_milliseconds value - operation In the write side I get some operations for a service ...
- 101
0votes
1answer
141views
Where should I store statistics about sent emails?
my application sends a batch of custom emails every day using mailgun (an email API service). I have a producer worker scheduled to run daily, and all does is query the database for the unique ...
- 109
3votes
0answers
413views
Redis set of sets - Is there a better Design?
I have a telegram bot that alerts whenever a price of certain asset reach a certain price. I have the following table in a DB: AlertId ChatId Price Asset So each Asset will have several ChatId (users)...
- 131
3votes
1answer
526views
Is my use case for Redis appropriate?
I'm writing a web app that is basically facebook events, but more impromptu and real time. A user can create an event, and other online users in the area (30 mile radius) should immediately see the ...
- 325
-1votes
2answers
360views
Using NoSQL as MQ and for maintaining state
Currently we have an application that doesn't scale well because of multiple concurrent updates to a table which gets locked. The tech stack is ASP.NET and backend is in SQL Server. To avoid database ...
3votes
0answers
2kviews
How should I store user activities in ElasticSearch and figure out popular searches?
I've got java logging user activities to Fluentd, Fluentd is then writing these activities into an elasticsearch index. Every user activity is recorded, some include: User1 follows user2 User1 likes ...
- 173
1vote
2answers
117views
Creating fast, realtime dialogue search for television scripts
We have a database of television scripts and we'd like to search it, getting results as we type. We often remember words or snippets of dialogue but can't remember exactly what was said or what ...
- 1,486
1vote
1answer
1kviews
What is a good practice to push notifications in a "near real-time" delay in this case?
I want to enable some real-time notifications about friend's activities (social network). Technical context is: Webapp calling backend (REST API's). Scenario is: Kevin follows Bob. When Bob ...
- 3,916
0votes
1answer
2kviews
Should I persist notification before or after publishing it through Redis pub/sub?
I'm implementing a mechanism to notify a group of users about newly inserted blog comments. The architecture uses the Redis Pub/Sub mechanism. By definition, the pub/sub mechanism aims to propagate ...
- 3,916
